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cross schools. The assessment procedure test was 
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clerical assistants, (2) implementation, (3) local 
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ABSTRACT 



The research project reported in this publication had 
as its purpose to revise and final test a procedure for 
assessing the educational and employment activities of former 
high school students. The revision was based on the results 
of a first pilot test conducted in three school districts 
during the 1972-73 school year. The final test was conducted 
in seven school districts during the 1973-74 school year. 
The procedure was evaluated on the basis of the validity and 
reliability, usefulness and cost of information collected. 
The assessment procedure was designed to be initiated, dir- 
ected and largely conducted by school personnel wishing .to 
assess the post-high school activities of their former stud- 
ents. Procedures consists of a set of data collection forms, 
a procedures manual for conducting the assessment, and a 
computer program to summarize the information for school use. 

In general, it was found that the assessment procedure 
met each of the criteria. The procedure provided valid and 
reliable status information about the educational and employ- 
ment activities of former students. The information was 
being used by the local schools. The procedure resulted in 
a return rate over the require.d 80% for all schools and time 
periods involved. It was concluded that the procedure could 
be implemented by clerical staff under minimal direction of 
a project director in the local school. The cost of assess- 
ment varied from $1.12 to $1.48 per student assessed, with 
an average of $1.24 per student. Total costs per school 
were alihost directly related to size of the group being 
contacted. By obtaining updated name and location inform- 
ation, the procedure would facilitate future assessment of 
the former students involved in the assessed groups. Since 
the same forms were used in all schools, it was possible 
to prepare summary reports for groups of schools within 
districts . 

Hopefully, the procedure, in final form, will serve as 
a useful aid to local schools in compiling a more complete 
set of information on which to base educational decisions. 
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CHAPTER I 



INTRODUCTION 

Assuming that educational programs at the high school 
level arc designed and developed to help students prepare 
for future activities after high school, it is important 
that educators identify relationships between the high 
school programs and students' post high school activities. 
One step in better defining these relationships is the 
identification of the post high school activities of former 
students. This information is a prerequisite to effective 
and efficient guidance and curriculum planning activities 
within the high school. While the total list of possible 
post high school activities in which students engage may be 
large, two important activities are further education or 
employment or both. Therefore, it seems apparent that in- 
formation about these major "ends" of the high school edu- 
cational process should be considered an essential input into 
the planning and evaluation of high school programs. This 
report presents the results of a second test of a procdure 
for conducting a school directed assessment of former high 
school students to obtain information about their post high 
school educational and employment activities. ^ 



Uses of the Information 

The information about the educational and employment 
status of former students can be useful to several groups 
of decision makers concerned with high school programs. 
For example, administrators, teachers, and guidance person- 
nel can use the information as (1) documentation of what 
happens to their students after leaving high school, (2) as 
a source of information for planning the school curriculum 
and guidance' services , and (3) as information to accurately 
complete local, state, and federal reports to insure account- 
ability. 

In combination with knowledge about the educational 
program pursued by former students, the information can also 
prove useful to students and parents in (1) deciding the 
combination of courses which will be taken in high school 
and (2) making decisions relative to activities to be re- 
tained or changed in the local high school. 



•^The first pilot test of the procedures was reported in 
August of 1973 in a publication entitled Status of Former 
II i gh School Students: Procedure for Local Assessment - 
Re port of the First Pilot Test by George Copa and Donald 
Trvin, and published by the Minnesota Research Coordinating 
Unit for Vocational Education. 
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By summarizing follow-up information from the several 
local school districts in the State, State Department of Ed- 
ucation officials can also use the information to assist 
in documenting the effect of state and federal monies spent 
on high school programs by identifying the numbers of persons 
who pursue various types of employment and/or further edu- 
cation - 



Criteria for Assessment Procedure 

In order for the assessment procedure to function 
effectively in providing information about former high school 
students, it was judged that several criteria would have 
to be met. The criteria and their justifications were as 
fol lows : 



Criteria 

Provide in formation 
useful in assisting 
local school person- 
nel in planning 
and evaluation . 

Largely directed, 
conducted and fin- 
anced by local 
School . 



3. Include all school 
leavers 



Provide valid and 
reliable '^status*' 
information about 
educational and 
employment act- 
ivities of former 
students . 



Justification 

■Local school personnel are 
the closest and have the 
most specific control over 
school programs . 



-Insured that the information 
collected is useful and worth 
the expense . 

-The large size of the pop- 
ulation to be assessed and 
the number of schools in- 
volved makes a centralized 
system difficult to manage. 

-Educational programs at 
the high school level are 
available to all students. 

-There are many interactions 
between, programs taken by 
students with differing 
educational and employment 
goals . 

■Employment and further ed- 
ucation are two of the most 
common student activities 
(ends) following high school. 

■Status information serves 
as baseline for identifying 
subgroups requiring further 
study. 
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Produce a high rate 
of response from 
former students. 



Reasonable cost 



Supply information 
which would simplify 
future assessment of 
same students. 



Provide consistent 

in formation across 
schools . 



'More feasible to get agree- 
ment within and between 
schools on ''status" as 
compared to ''attitudinal" 
information . 

•Need to insure valid and 
reliable information . 

•Low return would require 
additional procedures to 
validate the information . 

•Feasibility of implement- 
ation by local school is 
enhanced by lower costs. 

-Since only "status" infor- 
mation is collected, future 
assessments asking other 
kinds of information or 
dealing with particular 
subgroups may be necessary. 

■Necessary if information 
is to be aggregated among 
school within districts and 
districts within the State. 



Using these cirteria for guidance, a set of procedures 
and materials were developed to accomplish the task of pro-, 
viding status information on former high school students. 
These procedures and materials were first pilot tested and 
evaluated during the 1973-74 school year. Based on the 
results of that first test, the following changes were re- 
commended for future applications of the procedures and 
materials : 



1. Allow coding of students into each vocational 
education cluster in which he/she took classes while 
in high school; 

2. Allow more than five interest groups for local 
school use; 

3. Expand the number of occupational titles to provide 
more specific information on students post high school 
employment status; 

4. Provide for the addition of questions to the ques- 
tionnaire at the option of the local school; 
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5. Complete all coding on one form, rather than two, 
to simplify data handling; 

6. Provide for more efficient da^ta storage and re- 
trieval using optical scanning forms for reporting 
data ; 

7. Change the format of the data report tables so as 
to make easier interpretation; 

8. Hxpand the scope of procedures to include assessments 
of former students who had been out of high school 
for more than one or three years (i.e., two and 

five years) ; 



Based on these recommendations, the , procedures and materials 
vsrere modified to better meet the established criteria. The 
remaining chapters of this report describe (1) the revised 
procedure and materials to conduct a locally based assessment 
of former students and (2) the results of the final test of 
these procedures and materials. 
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CHAPTER II 

DATA GATHERING FORMS 

Given the criteria specified for the assessment procedure 
and the recommendations resulting from the initial pilot test, 
the first task was the modification of information gathering 
forms. Five of the previously given criteria were of primary 
concern during form modification. These criteria were: (1) 
provide information useful in assisting local school personnel 
in planning and evaluating, (2) provide valid and reliable 
"status'^ information on educational and employment activities, 

(3) produce a high rate of response from former students (80^), 

(4) supply information which would simplify future assessments 
of the same students, and (5) provide consistent information 
across schools. 

In addition, attempts were made to incorporate modifications 
based on the previously listed recommendations which resulted 
from the first pilot test of the forms. These recommendations 
were: (1) Allow ceding of students into each vocational educ- 
ation cluster in which he/she took classes rather than forcing 
him/her into only one cluster; (2) expand the number of occup- 
ational titles to provide more specific information on students; 
(3) place all information for computer analysis on one form 
to reduce errors; (4) allow for more than five local interest 
groups; and (5) provide for the addition of questions to the 
questionnaire at the option of the local school. 

Information to be Collected 

In order to design forms which would gather useful infor- 
mation, it was first necessary to identify the types of data 
which would be most helpful for program planning and evaluation. 
Based on the results of the first pilot test, it was decided that 
a combination of "in school" data and data about the post high 
school educational and/or employment activities of former 
students would provide the most useful information. The 
following categories of information were chosen to be gathered: 

1. In School Information (from School Records) 

Student's name 

Student • s address 

Parent * s address 

Parentis telephone number 

Bducational program during high school 

Student's sex 

Student ^s exit status 

2. Assessment Information 

Name 
Address 

Telephone Number 
Social Security Number 
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Brief history o£ employment and educational 

activities since leaving high school 
Present employment status and description 
Present educational status and description 

These categories of information and the procedural recom- 
mendations from the first pilot test were then used as guide- 
lines in developing data gathering forms. Two separate forms 
were developed. The first, designated as the Information Report- 
ing Form, was designed for a three fold purpose. I-irst, the 
form was used to record the *4n School*' data on the student 
- to be followed-up. Second, the form was used to summarize 
and code the follow-up data collected from the student at the 
time of the assessment. And third, the form was used as an 
integral part of the data analysis process. The second form 
which was developed was the Follow-up Questionnaire. This 
questionnaire was designed to collect status information about 
post high school activities from the former students. 

Information Reporting Form 

A copy of the Reporting Form is shown in Exhibit I. The 
sections of that form are described below as they relate to the 
three purposes listed above. 

Recording ''In School'' Data 

The first purpose of the Reporting Form was to record 
information about the student to be followed-up. This infor- 
mation was taken from the student's permanent record file. As 
shown on the sample Reporting Form, items 1, 2, and 3 collected 
the students name, telephone number and address, respectively. 
This information provided the primary means to contact the 
former student. Items 4, 5, and 6 on this form collected 
the names, telephone number and address of the student's parents 
or guardian. This data provided an alternative address to 
which questionnaires could be sent in an attempt to contact the 
former student. Item 7 and 8 provided another alternate address 
which could be used in an attempt to contact the student. 

The section entitled "CLASS OF", which appears in the upper 
right hand corner of the form, was used for coding the year the 
student graduated or in the case of a non-graduate the year 
he/she should have graduated. The section entitled "I.D. CODE" 
was included to allow for computerized storage and retrieval 
of the information on the form. The code number consisted of 
a four digit school code and a four digit student code. 

The "SEX" and "EXIT STATUS" section of the form provided for 
the coding of student's sex apd his/her status at the time of exit 
from high school. The sex categories are self explanatory. The 
exit status categories were defined as follows: 
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HIGH SCHOOL FOUOW-UP PROJECT REPORTING FORM 



1. Name 



2 Phone No, 



ddress 



4. Parent's Name 



5. Phone No 



6. Parent's Address 



7. Other Contact (i.e. relative or emergency number) 



8. New Address 
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School Student 
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(1) Graduate - the student completed his/her educational 
program and received a diploma. 

(2) Dropout - .the student left school without receiving 
a diploma and did not continue his/her education. 

(3) Other - the student left school without graduating 
or transferring to another school, but was not con- 
sidered a dropout. 

The remaining two section of the Reporting Form which 
relate to the recording of in school information are the 
"VOCATIONA'L CLUSTER" and "LOCAL INTKREST GROUP" sections. The 
"VOCATIONAL CLUSTER" area was used to classify the student on 
the basis of vocational courses in which he/she enrolled while 
in high school and the "LOCAL INTEREST GROUP" area was used 
to classify the student on the basis of his/her membership in 
one or more groups of interest to local school personnel. 
The student was classified as a member of a particular vocational 
cluster if he/she was enrolled in a vocationally reimbursed 
course fitting into that cluster of courses. As can be seen 
on the Reporting Form, twenty-six clusters were pre-specif ied . 
The student was classified into local interest groups on the 
basis of criteria established in the local school. No local 
interest groups were pre- speci f ied , thus, allowing the local 
school the option of selecting a maximum of twenty-six groups 
which were most useful to local school personnel. For examples 
of local interest groups used by local schools see Appendix II. 

Coding Follow-Up Data 

The second purpose of the Reporting Form was to provide for 
the summary and coding of the information received from the former 
student during the assessment procedure. The columns labeled "Ed. 
Rel., Ed. Unrel., Occ. Rel. and Occ. Unrel." were included for id- 
entifying the relationship between the students post high school 
activity and his/her high school program of study. Relatedness was 
defined by local school personnel. 

The "RECENT HISTORY" section of the Reporting Form provides 
the opportunity to code the former student's responses relating to 
his activities from the time he/she left school until the time of 
the assessment. Since the assessment procedure was used with 
students who had been out of^'^^hool for varying lengths of time, 
the time period designations al^. vary. These designations are 
shown in Table 1 as they relate to different times away from the 
school. For example, a school following-up the graduating class 
of 1969 would use five time periods, each period representing one 
year. In contrast, a school following-up the graduating class of 
1971 would use only three time periods. 



The Vocational Clusters used were identified for this 
project by the Secondary Unit, Program Operations Section of the 
Division of Vocational and Technical Education, "Minnesota Depart- 
ment of Education. 
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Table 1 

Time Period Designations for The Recent History Section 

of the Reporting Form 



Date of Graduating Class 


Time Period 


1969 


1970 


1971 


1972 


1973 


1 


1970 


1971 


1972 


1973 


Sept-Nov 


2 


1971 


1972 


1973 


X 


Dec- Feb 


3 


1972 


1973 


X 


X 


X 


4 


1973 


X 


X 


X 


X 


5 


Present 


Present 


Present 


Present 


Present 



The "Present Educational Status" section of the reporting form 
provides for the coding of information which describes the former 
student's educational status at the time of the assessment. The 
information to be coded in this section relates to whether the 
former student is now a full or part-time student, the type of 
educational institution in which now enrolled (i.e., public or _ _ 
private), and the geographic location of the educational institition 
attended . 

The "Present Employment Status" section of the Reporting Form 
provides for the coding of information which describes the former 
student's employment activity at the time of the assessment. The 
information to be coded in this section relates to whether the 
former student is full or part-time employed, occupational title 
of the job held, industry category of the business in which employed 
and geographic location of the job. 

The section of the Reporting Form entitled "NO MARKS" and 
containing five horizontal rows of numbered circles was used to 
provide the local school personnel with the capability of coding 
responses to ten questions of their own design, in addition to the 
standard questions on the questionnaire. These question were form- 
ulated by local school personnel. 



Data Processing 

The third purpose of the Reporting Form was in the data analysi 
process. To fulfil this purpose, the form was designed and printed 
to allow processing by optical scanning equipment. This equipment 
"read" the coded circles on the form and generated, a magnetic 
computer tape containing the data for each former student. This 
tape was then analyzed by computer to generate summary reports tor 
local schools. 
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Follow-up Questionnaire 

The second form developed for use in the assessment procedure 
was designed to gather educational and employment information about 
the former student. A copy of this form appears as Exhibit II. 

In light of the previously stated criteria, the questionnaire 
was designed to take advantage of known questionnaire character- 
istics which facilitated information gathering and maximized 
response. Examples of these characteristics included (1) items 
with low threat, (2) appealing color of paper on which the question- 
naire was printed, (3) ease of completion, and (4) reading level 
of questions. ^ 

The information needed from the former students was classified 
into four categories: (1) identifying information, (2) recent 
history information, (3) present educational activity information, 
and C4J present employment activity information. A brief explan- 
ation of each item is given below by item number as they appear 
on the questionnaire. 

Items numbered 1 and 2 recorded the following information: 
(1) name, (2) social security number, (3) present address, and 
(4) present telephone number. This information was collected 
primarily to identify students for future reference. The student's 
name may have changed as a result of marriage, for example, and 
the social security number provides a means for keeping all students 
separate in future studies. 

Item 3 requested information describing the kinds of activities 
e- ^aged in by former students since leaving school . As shown in 
1 libit II, item 3 was subdivided into three broad categories of 
a-tivities: (1) education, (2) employment, and (3) other activity. 

respondent was asked to check each of the activities appropriate 
iv him/her for each time period. The time periods which appear 
on the questionnaire were dependent on the length of time the group 
of former students to be assessed had been out of school. The time 
periods used by the schools included in this study were the same 
as previously presented in Table 1. The- questionnaire shown in 
Exhibit II was designed for use with students who were in the first 
year after leaving high school - the time period designations 
are, therefore, Sept. -Nov., Dec. -Feb., and Present. An individual 
could be in more than- o.ne .activity during the time period (i.e. 
going to school and employed). These time periods were chosen in 
order to obtain information on the sequence of activities pursued 
by students after leaving high school. 

Item 4 was to be completed only if the respondent checked one 
of the education activities in the present activity column. This 
item was developed to obtain specific information about the educa- 
tional activity in which the student was involved at the time of 
the follow-up. Item 4.1, for example, was designed to determine 
whether or not the respondent was a part-time or full-time student 
and items 4.2, 4.3, and 4.4 were designed to obtain information about 
the name, location and type of financing of the educational insti- 



ER?C i8 



RCU 111741 - 11 - 

EXHIBIT II 
HIGH SCHOOL FOLLOW-UP QUESTIONNAIRE 

PLEASE COMPLETE AND RETURN THE FORM BELOW. 



SCHOOL 



STUDENT 



2. Present Address: 



{Sireel or R R ) 



Phone:. 



(Area Code) 



(Numbc-r) 



<C«ly> 



(Stale) 



(Zip Code) 



3. Recent History: For each time period (column) in the YEAR FOLLOWING HIGH SCHOOL, check ) the ac- 
tivity or activities in which you were involved. Check at least one activity for each column. 
Note that you may respond to both the employment and education sections if they both apply. 



Activity 

Education: 

3.1 Vocational School 
Junior College 
College or University 
Apprenticeship 
Other Education 



Time Periods 



3.2 
3.3 
3.4 
3.5 



Sept. ' 

thru 

Nov. 



( ) 
( ) 



Dec 
thru 
Feb, 



( ) 
( ) 



PresenI (Complele even if same 
Acliviiy as other lime period) 



(Specify) 

Employment: 

3.6 Unemployed (looking for work) 

3.7 Homemaker 

3.8 Military (full time) 

3.9 Paid Employment 

Other Activity: (For example; ill, vacation, 
etc.) 

3.10 



( ) ( ) 
( ) ( ) 
( ) ( ) 



( )/ 

( ) 

( ) 

( ) 



■ If you marked here, 
complete # 4 below. 



( ) 
( ) 



( ) 
( ) 



( ) ( ) 
( ) ( ) 



( ) 
( ) 
( ) 

o- 



• If you marked here, 
complete #S below. 



( ) ( ) ( ) 



4. Present Educational Activity 

4.1 Kours PerWeek You Attend: 



1. 1to12 

2. 13to18 

3. 19 or more 



( ) 
( ) 
( ) 



4.2 School Name: 

4.3 School Address: 



(Ctly) (Stale) 

4.4 Typeof School: 1. Public ( ) 2. Private ( ) 

4.5 Major Area or Program: 

(For ex ample Autol^echanic. Elementary Teaching) 

4.6 Intended occupation after completing education 

(For example legal Secretary, Carpenter Teacher, undtcided. etc ) 



5. Present Employment Activity 

5.1 Hours Per Week You Work: 

1. Less than 30 ( ) ' 

2. 30 or more ( ) 



5.2 Job Title: 



(For example Truck Driver, Secretary) 



5.3 Employer: 



(company or Dusmoss name) 
(It sell employed, write 'selt *) 



5.4 Employer's Address: 



(Street or R R ) 



iC.ty) 

5.5 Kind of Business: 



(State) 



(For example. Farming. Retail Shoe Store) 

5.6 Supervisor's Name: 
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tution attended, respectively. Items 4.5 and 4.6 requested 
the respondent to identify his/her present area o£ study 
and intended occupation after completion of education, respec- 
tively. Information from these two items formed a basis 
for determining the degree of relatedness between post high 
school activity and high school education program. 

Item 5, Present Employment Activity, was to be completed 
only if the respondent checked Item 3.9, Paid Employment, in 
the present activity column. The purpose of this item was 
to describe the post high school employment activities of 
high school leavers. Within Item 5, Item 5.1 requested infor- 
mation about part-time or full-time employment status. Item 
5.2, Job Title, was included to determine the relatedness 
of the respondent's occupation to his high school program. 
In addition, this job title provided a means for classifying 
the former students by occupational title. Items 5.3 and 5.4 
requested .information about the name and location of the 
former student's employer. This information was desired to 
establish geographic location of the job and to provide a 
reference address for future studies, where employer might 
be involved. Item 5.5, Kind of Business, was used to classify 
the industry in which the former student worked. Item 5.6, 
Supervisor's Name, was included on the questionnaire to provide 
the name of a person who, if it was desired later, could be 
contacted for more information about the former student on 
his/her job. 
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CHAPTER III 



ASSESSMENT PROCEDURE 

The second task during the final test of the assessment pro- 
cedure was the modification and further development of a procedure 
by which the data could be gathered, organized and processed into 
a form useful to local school personnel. 

The primary concerns at this stage were that the procedure: 

(1) provide valid and reliable "status" information about educa- 
tional and employment activities of former students, (2) include 
all school leavers, (5) produce a high rate o£ response,. (4) be 
largely directed, conducted and financed by local scho.ol, and 
(5) bo conducted at a reasonable cost. To meet these criteria, 
an eight stage procedure was developed. Each of these stages was 
developed and placed in a procedures manual which was used to 
guide the local school in the conduct of the assessment. ^ In order 
to meet the criteria of low cost, the manual was designed to be 
self- ins tructional to clerical staff at the local school with 
minimum supervision from administrative or teaching personnel. A 
brief expiaucJtion of each of the eight stages is presented below. 

Stage 1 : Identification of Population and Sub-Groups 

Stage 1 of the procedures manual explained the methods to be 
used in: (1) Identifying the population to be followed-up and 

(2) identifying sub-groups of interest within this population. 
Forms designed to facilitate these processes were included in this 
section of the manual. 

Stage 2: Collection and Coding Base Information 

The second stage of the procedures manual presented directions 
for collecting baseline information on each student in the follow-up 
population. This information was taken from school records and 
coded onto the Reporting Form previously described. Once completed, 
these forms were filed in a 3-ring binder and became a primary 
reference for later stages of the procedure. 

Stage 3: Preparation and Mailing 

The method of data collection decided upon was a mailed 
questionnaire. The third stage of the procedures manual provided 
directions for the preparation and mailing of materials to each 
individual to be assessed. This section identified materials 
required, suggested a format for the cover letter and provided 
guidelines for efficient prepartion of the materials for mailing. 



Secondary School Follow-Up Project Procedures Manual, Minnesota 
Research Coordinating Unit for Vocational Education, University of 
Minnesota, 1975 (revised). 
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Stage 4: Questionnaire Return 

The fourth stage of the procedures manual presented directions 
for the handling of returned questionnaires. A "filing system" 
was described which allowed for accurate and efficient handling 
of the returned questionnaires to prevent loss or damage. 

Stages: Non-Respondents 

The primary purpose of the fourth stage of the procedures 
manual was to provide direction for obtaining data from those 
individuals who did iiot respond to the first questionnaire. The 
process described in tITis stage was a two step process. Direc- 
tions were given for the preparation and mailing of a second 
questionnaire to all individuals not responding to the first ques- 
tionnaire. A second step provided directions for contacting all 
non-respondents by telephone. 

Stage 6: Coding 

This stage of the .procedures manual presented guidelines 
and directions for the coding of the information on the Base 
Information Form and Follow-Up Questionnaire. Accurate coding 
was required if the data were to be summarized by computer. The 
following items were coded: 

(1) Extent of present education (part or full-time) 

(2) Education location (by economic region in Minnesota 
and out-of-state) 

(3) Relatedness of high school program to present educa- 
tion activity 

(4) Extent of present employment (part or full-time) 

(5) Relatedness of high school program to present employ- 
ment activity 

(6) Employment location (by economic region in Minnesota 
and out-of-state) 

(7) Occupational category of employment 

(8) Industrial category of employment 

Stage 7: Preparation for Data Analysis 

Directions were presented in Stage 7 for the preparation of 
the forms for data analysis. Emphasis in this stage was on local 
school examination of the forms to insure accurate data analysis. 
In addition, options available for processing were explained. 

Stage 8: Process Evaluation 

The eighth stage of the procedures manual contained process 
evaluation forms on which local project personnel could summarize 
information about follow-up procedures (i.e. costs, time require- 
ments, .suggestions for improvement). This information was collected 
to assist in the final revision of the assessment procedure. 
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CHAPTER IV 

DATA REPORTS 

Upon completion of the eight stages of the assessment pro- 
cedure the local schools sent the Reporting Forms to the Minnesota 
Research Coordinating Unit Cor Vocational Education for data 
processing. This section of the report describes the set of 
tables which were utilized to summarize the information collected. 
Note that the tables described form a set of tables (Tables 1-10); 
the school receives this set of tables for each group of former 
students (vocational cluster and local interest group) which was 
identified earlier in the follow-up procedure. The data presented 
in the Exhibits shown in this Chapter are intended for illustrative 
purposes only, they are not actual results from any of the partici- 
pating schools. 

Table 1 : Questionnaire Response 

The first table (See Exhibit III) was designed to summarize 
the responses to the assessment. The responses were divided into 
four categories: Return Complete, Return Incomplete, No Return 
Received, and Errors. The Return Complete Category contains the 
number of individuals who returned completed questionnaires. The 
Return Incomplete Category contains a count of those persons who 
returned questionnaires not sufficiently complete to be included 
in the analysis. The No Return Received Category includes those 
persons who failed to return a questionnaire and the Errors category 
indicates the number of reporting forms which contained coding 
errors which made inclusion in the analysis impossible. For each 
category, the results are presented for males , females , and the 
total group. In addition, the totals are presented as percentages. 

Table 2: Present Activity 

The information on the present activity of former students was 
presented in the second table of the set (see Exhibit III). This 
information was again provided for males, females, and the total 
group. The percentages in the percent column (PCT) were based on 
the total number of complete returns. The present activity cat- 
egories used for this table were divided into three broad categor- 
ies: Educational Activity, Employment Activity, and Other Activity. 

The Educational Activity category was further sub-divided into 
five categories: Vocational School, Jr. College, College or Uni- 
versity, Apprenticeship cind. Other Education. The Vocational School 
category includes those indicating they were enrolled in public 
or private vocational schools or institutes. The Junior College 
category includes those indicating enrollment in two year public 
or private junior colleges. The category. College or University, 
includes those enrolled in four year public or private colleges 
or universities. Those enrolled in apprenticeships programs 
were categorized in the category called Apprenticeship. If an 
individual was involved in educational activities not included 
in any of the above categories he/she was categorized into the 
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|:xhibit III 



-a = = = a: = = = = = =xs = x=xx= = r = 3 = a«==xn: 

TABLE 1 
QUESTIONNAIRE RESPONSE 



STATUS- 



RETURN CCKPLETE .., 
RTTURN INCGKPLETC , 
NC RETURN RECEIVED 
ERRORS 



HALE FEMALE 
592 664 
42 '"30 



634 694 



TOTAL PCT 

1256 94.6 

• ••• ••••• 

72 5.4 



1328 lOC.O 

s = = = = = = 3 = = : 



:s=sx = = za 



TABLE 2 



= = = = = = = = = « = = = = * = = scssicaxae 



PRESENT ACTIVITY 

HALE FEHALE 



EDUCATIONAL 

VGCATIONAL SCHOOL ... 

JR. COLLEGE 

COLLEGE OR UNIVERSITY 

APPRENTICESHIP , 

OTHER EDUCATION , 



EMPLOYMENT 

UNEHPLOYED 

HCKEMAKER , 

MILITARY , 

PAID EMPLOYMENT 



OTHER 

OTHER ACTIVITY .., 
NOT REPORTED ..... 

:x = x = = = = 3: = = sr=s = 3xra: = 3: 



TOTAL 



PCT 



67 


58 


125 


10. 0 


82 


66 


146 


11.8 


92 


111 


203 


16.2 


4 




4 


0.3 


5 


18 


23 


1.8 


47 


75 


122 


9.7 




57 


57 


4.5 


66 


19 


85 


6.6 


70 


421 


791 


63.0 


8 


3 


11 


0.9 


9 


3 


12 


l.O 



E ssss ssas 
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Other liducation category. 

The employment activity category was sub-divided into four 
categories: Unemployed, Ilomemaker, Military, and Paid Employment. 
The Unemployed category included those who indicated they did not 
have paid employment, Init were seeking it. The llomemakers* category 
included those individuals who were maintaining a household. The 
Military category contained those indicated they were in the mili- 
tary service full-time. Those working for pay were categorized 
in the Paid Employment category. 

The tJiird Present Activity category entitled Other contains 
the count of individuals who (1) reported that they were engaged _ 
in some'activity not categorized above or (2) did not report their 
present activity. 



Table 3: Combinations of Present Activities 

Table 3 represented an attempt to further specify the present 
activity status of students. Tt was possible for an individual 
to be counted in more than one category in Table 2, for example, 
Ilomemaker and Vocational School. Therefore, Table 3 presents 
several selected categories, each of which is independent of the 
others. The categories presented were selected for their antic- 
ipated usefulness to local school personnel and do not represent 
an exha.ustive list of possible categories. See Exhibit IV for 
an example of Table 3. 



Table 4: Time Status of Individuals In School At Present 

The time status of individuals who were in school at the time 
of the follow-up was presented in Table 4 (see Exhibit IV) for 
males, females, and total group. Full-time was defined as being 
enrolled for 19 or more hours per week for students attending 
vocational schools or institutes and 13 or more hours per week for 
students attending a junior college, college, or university. 
Students were classified part-time if they were enrolled m a voc- 
ational school or institute for 19 or fewer hours per week or m 
a junior college, college, or university for 12 or fewer hours 
per week. The Errors category included a count of processing 
errors. The Not Reported category included all students who did 
not report that they were in school at the time of the fcl]ow-up. 

Table 5: Time Status of Individuals Employed At Present 

The time status, part-time or full-time, of individuals who 
were employed at the time of the assessment was reported in Table 5 
(See Exhibit IV) for males, females, and total group. Full-time _ 
was defined as being employed 30 or more hours per week. Part-time 
was defined as being employed 29 or fewer hours per week. The Errors 
category contained a count of processing errors. Not Reported re- 
presented a count of those persons who reported that they were 
not employed at the time of the assessment. 
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TABLE 3 

COMBINATIONS OF PRESENT ACTIVITIES 



PRESENT ACTIVITIES- 



PAID EPPLOYKENT (ONLY) 
UNEr'PLOYEO (ONLY) .... 

HOMEfAKER (ONLY) 

EDUCATION (ONLY) 

PAID Et'PLOYKENT C 
PAID EMPLOYKCNT C 
PAID E^'PLOYFi:NT £ 
PAID cMPLOYHSNT C 
PAID 6^'PL0YKcNT £ 
EDUCATION £ HCHEfAKER 
eOliCATION £ UNEMPLOYED 
OTHER ACTIVITIES 



HCKEKAKER 

VCC. SCHOOL 

JR. COLLEGE 

COLLEGE OR UNIVERSITY 
OTHER EDUCATION , 



HALE 


r u r; H i. c 


TflT Al 
1 U 1 M L 


orT 


236 


285 
^ \j ^ 


•5?! 

^ £ 4 


"11 . a 


CO 


49 


75 


6.C 


53 


66 


119 


9.5 


AO 


36 


76 


6.1 




13 


13 


1.0 


45 


37 


82 


6.5 


59 


46 


105 


8.4 


25 


34 


59 


4.7 


2 


9 


11 


0.9 




4 


4 


0.3 


21 


24 


45 


3.6 


8 


3 


11 


0.9 






s = 3 = K £ = z = : 





s s X X s : 



:x: = = = =:s=rxxs=x = s:a: = = xxxxx = xss = = x = x = = x = = = xxxxxB2:e?r: 

TABLE ^ 



:xxx = s = a 



TIHE STATUS FOR INDIVIDUALS IN SCHOOL AT PRESENT 



STATUS- 



FULL TIME ... 
PART TIPE .., 

ERRORS 

NOT REPORTED 



KALE 


FEMALE 


TOTAL 


POT 


236 


242 


478 


38.1 


13 


11 


24 


1.9 


343 


411 


• • • • • 

754 


• • • • • * 

60.0 



:s3xxxssxsx=sxxxxxxxxxxi 



:s:sxxxxxscssxxxxxxxxxxxsxsxxsxsxx = sxi 

. TABLE 5 



TIKE STATUS FOR INDIVIDUALS EMPLOYED AT PRESENT 



STATUS- 



ss^xsxsxxss 



FULL TIME 

PART TIME 

ERRORS 

NOT REPORTED 



MALE 


FEMALE 


TOTAL 


PCT 


261 


276 


537 


42.8 


114 


139 


253 


20.1 






• • • • • 


• • • • • 


217 


249 


466 


37.1 



Kxxssxxxsxxa 



:xssxs« 
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Table 6: Location of Individuals Who Are In School 

The geographic location of individuals in school at the time 
of .the follow-up was summarized in Table 6 (See Exhibit V). The 
locations presented represent the eleven Minnesota Economic Regions, 
the four states adjacent to Minnesota, Canada, and other states. 
In addition, the locations of individuals were categorized by the 
type of education being pursued. The educational categories used 
were: Vocational School, Junior College, College or University, 
Apprentice and Other Education. A map indicating the boundries 
of the eleven Minnesota Economic Regions is shown as Appendix ill. 



Table 7: Location of Individuals Who Are Employed 

The geographic location of individuals who were employed at 
the time of the assessment was presented in Table 7 (See Exhibit V) . 
The locations used are the same as explained above for Table 6. 
The location information was presented for males, females, and total 
group. The percentages presented represent percentages of the 
total number of complete returned (See Table 1). 



Table 8: Industries In Which Individuals Ace Employed 

The information presented in "ible 8, was intended to categorize 
the employment activities of forme:- students by type of industry 
in which they were employed. The industry categories used were 
the same as the broad reporting categories used by the U.S. Bureau 
of the Census. These categories were: Agriculture, Fisheries and 
Forestry; Mining; Construction; Manufacturing; Transportation, 
Communication, and Public Utilities; Wholesale/Retail Trade; Fin- 
ance, Insurance, and Real Estate; Business and Repair Service; 
Personal Service; Entertainment and Recreation; Professional and 
Related Service; and Public Administration. A sample of Table 8 
is given in Exhibit VI. Percentages were based on the total number 
of complete returns (See Table 1). 



Table 9: Occupations In Which Individuals Are Employed 

Infoi-mation relative to the occupations in which individuals 
were employed at the time of the assessment was presented in Table 9 
(See Exhibit VIX) . The categories used for Table 9 were the same 
as those categories used by the U.S. Bureau of the Census; there 
are approximately 360 occupational categories if all were used. 
The data were again presented for males, females, and total group. 



Tables 10.0— 10.9: Recent History of Activities 

Tables 10.0 through 10.9 (where appropriate) were designed to 
summarize information relative to the ''flow" of individuals into 
and out of different educational and employment related activities 
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•= = * = = = = = = = s== = = = = = «»a = = ri: = = x = = a: = = = = r = = = i = = i 

TABLE 6 



LCCATICN OF INDIVIDUALS KHC ARE IN SCHOOL AT PRESENT 



LOCATICN- 



3 

5 
6 
7 



MINNESGTA ECONOMIC REGION I 
^'IKNESCTA ECCNCHIC REGION 2 
fINNeSCTA ECONC^'IC REGION 
KINNESCTA ECCNC^'IC REGION 
MINNESGTA- EC GNOMIC REGION 
HINNESCTA ECONOMIC REGION 
MINNFSGTA ECCKCMIC REGION 
MIK-NESOTA ECONOMIC REGION 8 . 
MINNESOTA ECCNOXIC REGION 9 . 
MINNESOTA ECCNCMIC REGION 10 
MINNESOTA ECONOMIC REGION 11 

NQP.TH DAKOTA , 

SOUTH DAKOTA 

IOWA 

VISCONSIN 

CANADA 

OTHER 

ERRORS ...i.jj = 

KOT REPORTED 



VCC. JUNIOR COLLEGE/ APPREN- 
SChOCL COLLEGE UNIVER. TICE 



OTHER 



121 IA3 
... "l 



1 

1 ■ 



2 
2 



11 

21 



29 
1 

13 
7 

80 
2 

,10 
1 
6 
1 

10 



s c • • • 



17 



1 

3 
1 



TABLE 7 



LOCATICN OF INDIVIDUALS WHO ARE EMPLOYED AT PRESENT 



LOCATION- 



MALE FEMALE 



TOTAL PCT 
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MINNESOTA ECONOMIC REGION 1 , 

MINNESGTA ECONOMIC-REGION 2 .... 

MINNESOTA ECONOMIC REGION 3 

MINNESOTA ECONCKIC REGION ^ .... 
MINNESOTA ECONOMIC REGION 5 .... 

MINNESOTA tCONCHIC REGION 6 

MINNESOTA ECONOMIC REGION 7 .... 
MINNESOTA ECONOMIC REGION 8 .... 
MINNESOTA ECONOMIC REGION 9 .... 

MINNESOTA ECONOMIC REGION IC 

MINNESOTA ECONOMIC REGION 11 ... 

NORTH DAKOTA 

SOUTH DAKOTA 

IOWA 

WISCONSIN 

CANADA 

OTHER , 

ERRORS 

NOT REPORTED 28 



2 
1 



1 
1 

2 



352 
2 
2 



1 



2 
4 



3 
1 



1 
1 

376 
1 
4 
1 
2 



12 
1 
4 



5 
2 

6 
1 
3 
1 

728 
3 
6 
1 
3 

• • • • • 

16 
3 
8 



0.3 

• • • • • 

C.A 
0.2 

• • • • • 

0.5 
0.1 
0.2 
0.1 
58.0 
0.2 
0.5 
0.1 
0.2 

• • • • • 

1.3 
0.2 
0.6 



Exhibit VI 
TABLE 8 

INDUSTRIES IN WHICH INDIVIDUALS ARE EMPLOYED AT PRESENT 





MALE 


FEMALE 


TOTAL 


PCT 




6 


1 


7 


0.6 








• • • • • 


• • • • • 




33 


3 


36 


2.9 




122 


89 


211 


16.8 




35 


15 


5C 


4.0 




134 


143 


277 


22.1 


FINANCE, INSURANCE, REAL ESTATE 


3 


45 


46 


3.8 




5 


4 


9 


0.7 




3 


10 


13 


l.C 




3 


7 


10 


0.8 




16 


83 


99 


7.9 




5 


11 


16 


1.3 






2 


4 


0.3 




8 


2 


10 


0.8 




ss sx zx 
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TABLE 9 

CCCUPATICNS IN WHICH INDIVIDUALS ARE EMPLOYED AT PRESENT 



HALE fEKALE TOTAL PCT 



CRAFTSMEN AND KINDRED KORKERS (CCNT) 

ELECTRICIANS 1 

ELECTRICIAN APPRENTICES 1 

GLAZIERS I 

INSPECTORS, N.6.C 1 

JFKLERS L V.ATCHKAKERS [ i 

MACHINISTS e 

AUTOFOBILE f'ECHANlCS 19 

AUTC.NCBILE MECHANIC APPRENTICES 2 

HOUSEHOLD APPL I ANCL-ACCESSORY INSTALLER, MECHANIC. . 1 

KISCELLANECUS MECHANICS £ REPAIRMEN 1 

PAINTERS, CONSTRUCTION £ MAINTENANCE 4 

PRESSMEN e PLATE PRINTERS, PRIMING 5 

PRESSMAN APPRENTICES 1 

SHEETMETAL WORKERS S TINSMITHS 2 

TELEPHONE INSTALLERS £ REPAIRMEN 

TILE SETTERS 1 

TOOL e DIE MAKERS i 

OPERATIVES, EXCEPT TRANSPORT 94 

ASSEMBLERS 35 

DRY WALL INSTALLERS; 6 LATHERS 1 

GARAGE KORKERS 6 GAS STATION ATTENDANTS 21 

MEAT WRAPPERS, RETAIL TRACE . . , 1 

PACKERS £ WRAPPERS, EXC. MEAT £ PROCUCE 1 

PAINTERS, MANUFACTURED ARTICLES 4 

PRECISION MACHINE OPERATIVES, N.E.C 2 

PUNCH £ STAMPING PRESS OPERATIVES 2 

SEKERS £ STICHERS 

WELOERS £ FLAME-CUTTERS 5 

MACHINE OPERATIVES, MISCELLANEOUS SPECIFIED 5 

MACHINE OPERATIVES, NOT SPECIFIED 16 

MISCELLANEOUS OPERATIVES 1 

TRANSPORT EQUIPMENT OPERATIVES 25 

BUS DRIVERS H 

OELIVERYM.Et^ fi RCUTEMEN 3 

FORK LIFT £ TOW MOTOR OPERATIVES 4 

TRUCK DRIVERS 7 

LABORERS, EXCEPT FARM 61 

CARPENTERS' HELPERS 3 

CCNSTRUCTICN LABORERS, EXC. CARPENTERS' HELPERS .. 21 

GARBAGE CCLLECTCRS 4 

GARDENERS fi GRCUNDSKEEPERS , EXC FARM 3 

WAREHOUSEMEN, N.E.C 6 



73 
59 



1 
1 

5 



1 
1 



1 
I 
1 

2 
1 
9 
19 
2 
I 
1 
5 
5 
1 
2 
1 
I 
I 

167 

94 
1 

22 
2 
6 
4 
2 
2 
I 
5 
6 

20 
2 

26 
12 
3 
4 
7 

63 

3 
21 
4 
3 
6 
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since they left high school. The tables each present data about 
the activities of individuals during two periods of time. For 
Example, Exhibit VIII presents hypothetical data concerning the 
activities of students during time periods 1 and 2. Note that^ 
these tables must be '*read** by looking at only one cell at a time. 
Since individuals can be in more than one activity at a given 
time, no row or column summation can be done without the possibility 
of double counting. The time periods corresponding to the notation 
"Time 1, Time 2, etc." is the same as was described in Chapter III 
of this report. For example, i£ the table shown in Exhibit VIII 
was generated from a one-year follow-up, the time periods would be: 
Time 1 = September through November, and Time 2 = December through 
February. However, if the table had been generated for a three 
year follow-up the time periods would have been: Time 1-1972 
and Time 2 = 1973. 



Table 11 : Educational Relatedness 

The intent of Table 11, see Exhibit IX, was to summarize the 
relatedness of former student's educational activity at the time 
of the follow-up to their high school programs. This table was 
included only in the sets of tables which summarized across groups 
of student categorized by vocational clusters and by special 
interest groups. Each school was permitted to use definitions of 
relatedness which would prove most useful to local personnel. 



Table 12: Occupational Relatedness 

The relatedness of former students' employment activities at 
the time of the follow-up to their high school programs was presented 
in Table 12, see Exhibit IX. As with Table 11, local school personnel 
were required to form their own definitions of relatedness. 

Tables 1 3.0—1 3.9: Questions (Optiona!) 

Tables 13.0 through 13.9 appear as part of the set of reports 
only if the local school chose to add questions to the basic question- 
naire. These tables summarize the frequency of response to each 
possible answer for each question. The data are presented for 
males, females, and total in each table. Due to the variable 
nature of questions which were most useful to different schools, 
no questions were included for use by all schools and a sample 
table is not shown. 
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Exhibit VIII 



TIKE 2 



TIKE 1 



V 
0 
C 
A 
T 
I 
0 
N 
A 
L 

S 
C 
H 
0 
0 
L 







S 3 S S S 




ssssssss 




sss 




TABLE 


IC.O 
















ICC 




TIKE 


PERIGO 1 


TO 


TIKE 


PERIOD 


2 






J 


C 


A 


0 


u 


H 


K 


p 


0 




R 


0 


P 


T 


N 


0 


I 


A 


T 


r 


• 


1 

L 


P 


H 


E 


H 


L 


I 


H 


T 




L 


R 


E 


H 


E 


I 


D 


E 




C 


C 


E 


R 


P 


M 


T 




R 


R 


0 


Q 


N 




L 


A 


A 


E 




E 


1 

L 


E 


T 


E 


0 


K 


R 


M 


A 


p 


L 




I 


0 


Y 


E 


Y 


P 


c 


r 

V 


r 
C 


c 


C 


u 


E 


R 




L 


T 


R 


G 


R 


E 


C 


C 






0 


I 


T 


C 




S 


A 








Y 


V 


E 




U 


H 


T 








H 


I 


c 




n 


I 


I 








E 


T 






r 
I 


P 


0 








H 


Y 






V 




N 








T 








E 


• 












• 






R 


• 


« 










• 






S 














• 






I 


• 












• 






T 


• 












• 






Y 


• 












• 








• 


















• 


• 












• 






• 


• 












• 







125 


1 

146 


• • • • 

3 


1 


I 
1 


7 
11 
18 


2 
2 


1 


97 
123 
69 
7 


1 .... 


COLLEGE OR UNIVERSITY .. 


• • • • 

1 


2 

• • • • 


201 
1 


• • • • 

1 
8 


• • • • 


1 


• • • • 

• • • • 








1 
8 






28 
1 


2 , 






15 
27 
12 
1 






7 


• • • • 

lA 
1 


• • • • 

• • • • 


67 
2 


3 


1 


2 .... 
1 .... 












1 , 
12 
1 




• • • • 

69 
10 
1 


• ••• •••• 




77 

2 


IC6 
2 


60 
1 


7 

• • • • 


22 
2 


12 
2 


703 
7 
20 


2 1 
9 .... 
.... 12 



ERIC 



32 



- 25 - 

lExiubit IX 



TABLE II 

RELATEOKESS GF PRESENT ECUCATICNAL ACTIVITY 



STATUS KALE FEFALE TOTAL PCT 

RELATED 2 7 9 20.0 

UNRELATED A 4 8.9 

6QTH ........»....* ..... ..... ..... 

ERRGRS ••••••.....>...... ..... ..... ..... ..... 

NCT REPORTED 2 31 33 73.3 



TABLE 12 

RELATEDNESS OF PRESENT EMPLOYMENT ACTIVITY 



STATUS MALE FEMALE TOTAL PCT 

RELATED I 22 23 51.1 

UNRELATED = * I 6 7 15.6 

BOTH ..... 

ERRORS 

NOT REPORTED 2 lA 16 35.6 
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CHAPTER V 

TEST OF THE ASSESSMENT PROCEDURE 

In order to evaluate the assessment procedures described in 
previous chapters of: this report, a test was conducted in fourteen 
different Minnesota High Schools in seven Minnesota school districts. 
The criteria stated in Chapter I which formed the basis on which 
the procedure and forms were developed served as the primary eval- 
uation criteria. These criteria in question form were: 

1. Did the procedure provide information useful in assisting 
local school personnel in planning and evaluation? 

2. Could the procedure be' largely directed, conducted and 
financed by the local schools? 

3. Were all school leavers included in the assessment pop- 
ulation? 

4. Did the procedure provide valid and reliable status infor- 
mation about the educational and employment activities 

of former students? 

5. Would the procedure produce a high rate of response from 
former students? 

6. What was the cost of implementing the procedure? 

7. Would the procedure supply information which would simplify 
future assessment of the same students? 

8. Did the procedure provide consistant information across 
schools? 



Sample 

The schools participating in the test of the procedure were 
chosen from a list of schools that had indicated an interest to 
the State Department of Bducation. The following three criteria 
were used in selecting the schools: 

1. Represent different sizes of districts (as measured by 
total number of graduates per year) . 

2. Represent different geographic area of the State 

5. Willing to finance conducting the assessment study 

The school districts participating in the final test of the assess- 
ment procedure were: (1) Independent School District Number 11 in 
Anoka, (2) Independent School District Number 834 in Stillwater, 
(3) Independent School District Number 623 in Roseville, (4) Indep- 
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cndcnt School District Number 256 in Redwing, (5) Independent 
School District number 535 in Rochester, (6) the three independent 
school districts which were associated with Oakland Vocational Center 
District, and (7) the three independent school districts associated 
with the Agassiz Valley Vocational Center. 

Independent School District 11 serves the communities of Anoka, 
Coon Rapids, and Blaine, Minnesota. The District has two existing 
high schools, Anoka Senior High and Coon Rapids Senior High, which, 
in combination, graduate approximately 1300 students per year. 
The District is one of the largest, in terms of enrollment, in 
the State and is located in economic Region 11. Some parts of the 
District may be considered a close suburb of Minneapolis and St. 
Paul. 

Independent School District 834 contains the community of 
Stillwater, Minnesota, a city also located in economic Region 11. 
However, Stillwater is approximately 25 miles east of the Minneapolis- 
St. Paul area and is generally not considered a suburb of the Twin 
Cities. The District has one high school, Stillwater Senior High, 
which .graduates approximately 450 students per year. 

Independent School District 623 serves the community of Rose- 
villc, Minnesota. The Rosevillc district has two high schools, 
K'eiiogg Senior High and Alexander Ramsey Senior High, which, in 
combination, graduate approximately 1000 students per year. The 
District is located in Economic Region 11 and may be considered 
a suburb of the Twin Cities. 

Independent School District 256 serves the community of Red 
Wing, Minnesota, located approximately 60 miles south of the 
Minncapolis-St . Paul Metropolitan area. The District has one 
high school. Red Wing Central, which graduate approximately 300 
students annually. 

Independent School District 535 serves the community of Rochester, 
Minnesota. The district is located approximately 100 miles south 
of the Minncapolis-St. Paul area in economic Region 10 and is one 
of the four largest communities, outside of the metropolitan 
area., in the State. Rochester has two high schools. Mayo Senior 
High and John Marshal Senior High, which, together, graduate about 
950 students per year. 

The Oakland Vocational Center is one of the secondary vocational 
centers designed to provide vocational education to students from 
several independent school districts. The school districts served 
by this vocational district include: (1) Cambridge, (2) Princeton, 
and (3) St. Francis. These districts, in combination, graduate 
approximately 400 students per year. 

The Agassiz Valley Vocational Center is another of the second- 
ary vocational centers designed to provide vocational education 
to students from several independent districts. The districts 
served by this vocational center include: (1) Climax, (2) Crookston, 
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and (3) Fertile. These districts, in combination, graduate approx- 
imately 250 students per year. (Note: Due to changes in personnel 
at the schools involved with this vocational center, the procedure 
was not completed in time £.or results to be included in this report.) 

In summary, the school districts selected for the_£inal test 
of the assessment procedure were located in different geographic 
areas of the State and were different relative to size of student 
population. Gach school district also agreed to finance the cost 
of testing the assessment procedure on their former students. 



Methods 

An attempt was made to conduct the test of the assessment pro- 
cedure under conditions which would least represent an experimental 
or special situation. Efforts were made to have the school districts 
treat the assessment procedure as a part of their regular on- 
going activities and expenses. 

The Minnesota Research Coordinating Unit for Vocational Educa- 
tion developed and supplied each school with a manual for implement- 
ing the assessment procedure, associated forms and materials and 
conducted: (1) a workshop on the use of the procedure and forms 
and (2) a summary meeting with school personnel to discuss the 
procedures, costs and results of the asses-sment. In addition, 
the Research Coordinating Unit: (1) made available a computer 
program to summarize the data collected and (2) did trouble-shooting 
on problems encountered by the local schools. 

Each local school had the responsibility of providing a pro- 
ject director and clerical assistant to conduct the assessment. 
This staff identified the group of former students to be assessed, 
completed the assessment procedure and kept a record of the activ- 
ities, costs and problems encountered during the study. 

The test of the secondary school assessment procedure was 
carried out in four steps. The first step was accomplished by 
conducting a workshop in which the local directors and local 
clerical assistants were familiarized with the assessment proce- 
dures and instruments. This workshop was held in December and 
lasted one day. 

The second and third steps, conduct of the assessment and local 
process evaluation, respectively, were completed simultaneously 
during the months of February through May. Both of these steps 
were conducted completely by the local school district personnel; 
staff from the Minnesota Research Coordinating Unit for Vocational 
Education were available to answer questions about the assessment 
process. The second step involved implementing the assessment 
procedure previously presented in this report. The third step, 
local process evaluation, was intended to permit the local school 
personnel involved in the test to make comments and recommendations 
about the procedures as they worked through them. To accomplish 
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this objective, each individual involved completed a procedures 
diary in which they • recorded the following information: 

(1) Problems encountered 

(2) Time spent on different tasks 

(3) Expenses incurred 

(4) Recommendations and comments 

The fourth step of the pilot test was a summary evaluation 
of the procedure which was conducted at the completion of the test 
by the Research Coordinating Unit. The RCU also directed the 
development of a computer program which would summarize the foUow- 
up data for each school. This program was written and operated 
at the St. Paul Campus Computer Center, University of Minnesota. ^ - 



Results 

The results of the pilot test of the assessment procedure 
are presented below as they relate to the questions stated at the 
beginning of this chapter. 

1 . Did the procedure provide information useful in assisting 
local school personnel in planning and evaluation ? 

Due in part to the lack of time since the local school 
personnel received the final reports of the pilot test, a com- 
plete answer to this question was not possible. However, some 
immediate uses of the data were made by the local schools. These, 
were: (1) use the data as summary information to inform local 
school boards, parents, and teachers about the employment and 
educational status of former students, (2) use the data to identify 
employers who hired former students (in conjunction with another 
research project, these employees are now being visited by school 
personnel)^ (5) use the information to identify the schools at- 
tended by former students (guidance and counseling information 
about these schools is being collected for student use) , (4) infor- 
mation on special interest groups (i.e. dropouts) is being used 
to examine school policies and procedures as they effect these 
groups, (5) use of the information for curriculum review as part 
of the implementation of a management by objectives procedures, 
and (6) use of the information in program evaluation for acredi- 
tation purposes. It is anticipated that further uses will be 
identified after local school personnel have more time to inspect 
the assessment reports. The schools involved in the pilot test 
will be contacted again and asked how they had or would use the 
assessment information in their planning and evaluation. 

2 , Could the procedure be largely directed, conducted and financed 
by the local school ? 

The follow-up procedure was designed to be a self contained 
and self sufficient procedure.^ That is, after the initial train- 
ing workshop, the local project personnel were to conduct 
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the assessment with minimum assistance from the Research Coordin- 
ating Unit. Responsibility of the Research Coordinating Unit 
differed in this test from the first pilot test in that no site 
visits were made to the schools while they were conducting the 
assessment . 

During the test, it was found that the procedure was 
largely self sufficient. The local school personnel were able 
to conduct all parts of the procedure except computer analysis 
without excessive help by the Research Coordinating Unit. Problems 
which did arise were minor interpretation problems which could be 
answered on the telephone. 

The local schools did need assistance to obtain computer analysis 
of the assessment data. This was primarily because the analysis 
was conducted at a university facility and could be more efficiently 
arranged and conducted by the Research Coordinating Unit. 

3 . Were all for mer students included in the assessment population ? 

The assessment procedure was designed to assess ali former 
high school students regardless of the high school program taken 
(i.e. vocational, general, college preparatory). Each of the 
school districts participating in the pilot test assessed their 
total group of former students. These groups of students were 
different for different schools. In addition to testing the use of 
the follow-up procedure with students who were out of school one 
and three yoars as was accomplished in the first pilot test, during 
this second test, students put of school two. and five years were 
also included. Graduating classes of 1969^ 1970, 1971, and 1973 
were included in the process although no schools assessed more 
than two of these classes. The groups which were assessed are 
shown in Table 2 for each school which participated in the study. 



Table 2; Class of Students Follow-Up By Each School 



School 






Class 


Of 




1973 


1972 


1971 


1970 


1969 


Anoka Sr. High 

Coon Rapids Sr.. High 

Stillwater Sr. High 

Redwing Sr. High 

Kellog Sr. High 

Ramsey Sr. High 

Cambridge Sr. High 

St. Francis Sr. High 

Princeton Sr. High 

Mayo Sr. High 

John Marshall Sr. High 


X 
X 
X 


X 


X 
X 
X 




X 
X 
X 
X 
X 



4 . Did the procedure p rovide valid and reliable status i nformation 
about the educational and employment activity of former students ? 

Inspection of the final reports for the schools involved 
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revealed that the procedure did supply information about the 
status of former students relative to their post-high school 
educational and/or employment activity. In addition, in- 
formation was summarized concerning the geographic location 
of former students and a brief history of their activities 
since leaving school. 

The major sources of error in validity and Teliability 
for the information could be: (1) not having responses from 
the complete group being assessed, (3) former students not 
answering the questions accurately (for several reasons), 
and (3) clerical staff not coding the responses correctly. 
Because of the high rate of response obtained which is 
documented in the answer to the next question, the error 
duo to not having a response from everyone in the group 
being assessed was assumed to be small. Error in inform- 
ation due to respondents not completing the form accurately 
was not directly assessed. However, very few questionnaires 
were incomplete or had inconsistent responses which indicated 
that directions for completing the follow-up questionnaire 
were understood and that the respondents made some effort 
to accurately complete the questionr asked. 

Error caused by incorrect coding by clerical staff could 
be of two types. The first involves choosing an incorrect 
code. The second type of error was a failure to sufficiently 
darken the appropriate circles on the Reporting Form or 
omit a code on the Form. Errors of the first type were to 
be checked by the project directors in the local schools. 
It was assumed that this was done and that the coding was 
correct. However, errors of the second type, omissions and 
improperly darkened circles, were assessed by a computer 
program; and in some cases were found. to be of sufficient 
number to delay final processing of the Reporting Forms 
until the Forms could be corrected. An investigation of 
the optical scanning type of reporting form indicated that 
the error caused by inadequate darkening of circles could 
be corrected in the future by using a special pencil for 
coding. purposes . 

In summary, it was concluded that the information col- 
lected by the assessment procedure had sufficient validity 
and reliability to make it useable. 

5 . Would the procedure pro du ce a high rate of response 
from Tormer students ? 

In order to maximize the usefulness of the data collected 
by the assessment procedure, a goal of 801 questionnaire 
return rate ivas set for the pilot test. This goal was exceeded 
by all school districts participating in the pilot test, 
regardless of the length of time tiie former students had been 
out of school. The numbers and percent of returns achieved 
at each stage of the assessment procedure is shown in Table 3. 
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In general, the first mailing of the questionnaire elicited 
between 43o and 54-6 return while the second mailing resulted 
in an additional return of between 12% and 31%. 

The third stage of the procedure, telephone calls to 
all remaining non- respondents , accounted for between 18% 
and 25% additional returns. However, since the information 
requested on the questionnaire was descriptive in nature, 
any person with a knowledge of the non-respondent's post- 
high school activities could respond to telephone calls. 
Vov example, responses were accepted from parents, brothers, 
or sisters and wives or husbands. It was concluded that 
the foJioW"up procedure would produce the required 80% 
questionnaire return. This was true for all time periods 
included in this test. However, it was apparent that higher 
returns were obtainabJe from students who had been away 
from school shorter periods of time. 



Table 3 



Returns for Hach Stage of the Assessment Procedure 
and Length of Time Student Had Been Out of School 







One Year 


Two 


Years 


Three Years 


Five 


Years 




No 


'0 


No. 




No. 




No. 




Stage 


1 


774 


43.0 


192 


45. 7 


.582 


43.3 




54.5 


Stage 


2 


S55 


50. 8 


124 


28.2 


265 


19. 7 


162 


12.5 


Stage 


3 


369 

1 


20. 5 


81 


18.5 


329 


24. 5 


240 


18. 5 


Total 


1698 


94. 3 


397 


90.4 


1176 


87. 5 


1109 


85.5 


Base 


1801 


100.0 


439 


100.0 


1343 


100.0 


1298 


100.0 
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6- What was the cost of implementing the procedure ? 

One responsibility of the local school was to keep a record- 
of all costs incurred by the assessment project. A summary of 
these costs for major cost factors and length of time the students 
had been away from the high school is shown in Table 4. 

As can be seen in the total column of Table 4, clerical time 
was the largest single factor contributing to the cost of the 
assessment. The average being 52% of the total cost of conducting 
the assessment. The postage and analysis of the data cost factors 
contributed 19'^ and 18%, respectively, to the cost of the assessment. 
And the remaining 11% of the total cost was accounted for by the 
generation of a computer tape, 6%, and the purchase of needed supplies, 
5«. Note that the contribution of each cost factor remained fairly 
constant across all time periods. 

Tn order to establish a base on which comparisons could be 
made, the cost per students was calculated for each time period, 
or length of time students had been away from the high school. * 
These calculations are presented in Table 5. 



Table 5: Cost Per Student and Length of Time 
Away from the High School 





Total Cost 


Number of 
Students 


Cost/Student 


One Year 


$2,006.60 


1801 


$1.12 


Two Years 


569.30 


459 


1.30 


Three Years 


2,002.17 


1360 


1.48 


Five Years 


1,555.43 


1345 


1.16 


TOTAL 


$6,133. 50 


4945 


$1.24 



As can be seen in Table 5, the costs per students ranged from 
$1.12 per student for a one-year follow-up to $1.48 per student 
for a three-year follow-up. And the average across all time periods 
was $1.24 per student. 

7. W ould the procedure supply information which would simplify 
Tuture assessments of the same studentT ? 

Since only status information was collected in the present 
assessment, it was desirable that this process also provide infor- 
mation which would facilitate future assessments of these same 
students for other types oC information. For example, a school 
might want to assess the '^attitudes toward work" of a specific 
subgroup of the original follow-up population. As a means of 
facilitating future contacts with the former student, the present 
assessment procedure was designed to obtain the following information: 
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(1) Most recent address and telephone number 

(2) Address of employer (if employed) 

(3) Name of immediate supervisor (if employed) 

(4) Address of post-secondary education institution (if 
going to school) 

8. Did the procedure provide consistent information across schools ? 

Since all schools agreed to use the same follow-up question- 
naire, the information gathered was consistent across schools. In 
districts with several high schools, reports were prepared for 
each school and a summary report including all schools in the 
district . 



Summary 

In summary, a revised procedure to assess the educational and 

employment status of former high school students was tested in 

six Minnesota high school districts. The test was conducted to 

determine the degree to which a set of pre-specif ied criteria were 

met by the procedure. 
* 

In general, it was found that the assessment procedure met 
each of the criteria. The procedure provided valid and reliable 
status information about the educational and employment activities 
of former students. The information was being used by the local 
schools. The procedure resulted in ,a return rate over the required 
80^0 for all schools and time periods involved. It was concluded 
that the procedure could be implemented by clerical staff under 
minimal direction of a project director. The cost of assessment 
varied from $1.12 to $1.48 per student assessed, with an average 
of $1.24 per student. Total costs per school were almost directly 
related to size of the group being contacted. By obtaining updated 
name and location information, the procedure would facilitate 
future assessments of the former students involved in the pilot 
test populations. Since the same forms were used in all schools, 
the information reported was consistent between schools which would 
facilitate summary reporting for groups of schools within districts. 
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CHAPTER VI 

RECOMMENDATIONS 

Based on the results and evaluation of the final test of 
the assessment procedure, the list of recommendations presented 
below was formulated. Tn light of these recommendations, the 
assessment procedure and materials are presently being reviewed 
and will be modified where needed and published in final form. 
The recommendations are listed by procedure stage to which they 
relate. 

Sta ge 1: Identification of Population and Sub-groups 

1. Incorporate more emphasis on choosing which class is to 
be assessed. Add information about the differences in 
data received from one vs. three vs. five year follow-ups. 

2. Provide samples of useful local interest groups. Due to 
the cost of generating reports, local .schools should select 
local interest groups carefully; only those groups of 
primary interest should be included. 

3. Re-dofine the list of vocational clusters to more closely 
reflect the types of courses available at the secondary 
level. This may be accomplished by adding more undefined 
clusters, thus, allowing local personnel the option of 
including special vocational programs (i.e. special needs 
programs, work study programs). 

Stage 1\' Collection and Coding Base Information 

1. Include more emphasis on the importance of correctly 
following coding procedures in an effort to eliminate 
problems in data analysis. 

2. Provide liquid ink coding pens, to replace pencils, for 
' use in coding forms. This should significantly reduce 

one of the most prevelant coding errors. 

Stage 5: Preparation and Mailing of Questionnaires 

No changes were recommended for this stage. 
Stage 4: As Questionnaires Are Returned 

No changes were recommended for this stage. 
Stage 5: Non-Respondents 

1. Emphasize the need to follow the prescribed time schedule 
for the second mailing. 

2. Provide more complete instructions relative to the pre- 
paration for the second mailing of questionnaires. 
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Stage b: Coding 

1. Again, as in Stage 2, more emphasis should be included 
about the importance o£ strict adherence to coding 
directions. 

2. Eliminate coding of ^'relatedness*' , The detail reporting 
of occupational titles and educational programs will make 
this unnecessary and result in significant saving of cler- 
ical time during coding. Determination of degree of 
"relatedness" will be the responsibility of the reader. 

3. Modify the Reporting Form to allow the option of having 
it keypunched as well as optically scanned. This would 
be helpful for correcting errors found during data pro- 
cessing and allow efficient processing for small groups 
of students. 

4. Code geographic area by county and community as well as 
economic region. Coding in this manner will allow the local 
school to more closely define where its former students 
work and go to school. 

5. Provide for detailed coding of educational institutions 
and educational programs so as to parallel the information 
on occupations . 

6. Add a section in which the wage ranges of employed indiv- 
iduals could be coded. 

Stage 7: Preparation for Data Summary 

1. Emphasize the need for "local checking" of all forms 
for completeness and validity. 

Sta ge 8: Completion of Process Evaluation 

No changes were recommended in this stage. 

Final Reports to the Schools 

1. Drop tables on "relatedness" (Table 11 and 12) 

2. The set of Recent History Tables, Tables 10.0 through 
10.9 should be re- formated to improve their interpreta- 
biLity. 

3. Eliminate separate report sets for "males", "females", and 
^ "graduates" . 

A, 

4. Establish the base for percentages Cor any given table 

as the total included in that table rather than the total 
who returned complete questionnaires. 
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5. Provide tables indicating the names of educational insti- 
tutions and educational programs in which former students 
enrolled. 

The above recommendations will form the basis for the modification 
of both the assessment procedure and the assessment materials. 
The goal is to produce a set of tested materials and procedures 
which can be made available to local school that desire to conduct 
an assessment of their former students. 
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APPENDIX II 

Possible Local Interest Groups 

/rho following list o£ local interest groups represents a 
partial list of groups used by schools during this test of the 
assessment procedure and is included to provide examples of groups 
which can be useful to local school personnel.. 

High absentee students 
Low absentee students 
Upper third of graduating class 
Middle third of graduating class 
Lower third of graduating class 
College preparatory students 
Vocational students 
Work-study students 
Students who participated in athletics 
National Honor Society students 
Students who worked while in high school 
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APPENDIX III 

Minnesota Economic Regions 
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